Papers with proxy evaluation methods
Evaluating Research Novelty Detection: Counterfactual Approaches (D19-53)
Copied to clipboard
| Challenge: | Despite its importance, this direction of research has not been explored as much. |
| Approach: | They propose to use counterfactual simulations to evaluate paper novelty detection models . they ask models to differentiate papers at time t and counterf actual paper from future time . |
| Outcome: | The proposed models can be compared against a set of papers with a given date and with different annotations. |